Princeton AI Lab launches SSoN benchmark: human accuracy 83.3%, while large models reach only 39.7% at best
Princeton University AI Lab releases the spatial intelligence benchmark SSoN, stripping away dynamic interaction and action control to specifically test AI's static cross-view 3D spatial understanding. In the four-option 'spot the anomaly' indoor spatial questions, human accuracy is 83.3%, while mainstream vision-language models reach at most only 39.7%, and most are even below the random baseline, exposing a clear shortcoming in current AI's spatial understanding.